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PROGRAMMABLE RESOLUTION 

APPARATUS AND METHOD FOR 
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COUPLED DEVICE AND SCANNING 
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CODE READER 

METHOD AND APPARATUS FOR 
DECODING TWO-DIMENSIONAL BAR 
CODE USING CCD/CMD CAMERA 
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August 28, 1990 
February 17, 1989 

March 18, 1987 

January 30, 1987 
March 28, 1985 



AUTO FOCUSING BAR CODE READER 

SYMBOL READER 

LASER RANGE IMAGING SYSTEM 
BASED ON PROJECTIVE GEOMETRY 

OPTICAL INFORMATION READING 
APPARATUS 

LINEAR DEIVERGING LENS 

THREE-DIMENSIONAL RANGE 
CAMERA 



NUMBER 



FOREIGN PUBLICATIONS 



PUBLICATION DATE TITLE 



WO 01/71419 A2 September 27, 2001 



WO 01/72028 Al September 27, 2001 



60/190,273 
WO 99/64980 



May 29, 2001 
December 16, 1999 



LARGE DEPTH OF FIELD LINE SCAN 
CAMERA 

COPLANAR CAMERA SCANNING 
SYSTEM 

COPLANAR CAMERA 

IMAGING ENGINE AND METHOD FOR 
CODE READERS 



TECHNICAL PUBLICATIONS 

Product Brochure for "Model 120 LIVAR® Short Wave IR Gated Camera Specification" from 
Intevac Corporation, Santa Clara, California (Pages 1-7). 

Weblink to "New LIVAR® Imagery" from Intevac Corporation, Santa Clara, California 
(http://www.intevac.com/livar_imagery/livar_imagery.html.) (Pages 1-9). 

Product Brochure for "Lasiris SNF Laser" from StockerYale Corporation, Salem, New Hampshire 
(Pages 1-4). 

Product Brochure for "AV3700 High Speed CCD Bar Code Reader" by Accu-Sort® Systems, Inc., 
Telford, Pennsylvania (Pages 1-2). 
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Product Brochure for "DALSA IT-P4 Image Sensors" from Dalsa, Inc., Waterloo, Ontario, 
Canada, (Pages 1-14). 

Product Brochure for "KAF-4202 Series" from Eastman Kodak Company, Rochester NY, 
(Revision 1, Pages 1-15, June 29, 2000). 

User's Manual for "Piranha CT-P4, CL-P4 Camera" from Dalsa, Inc., Waterloo, Ontario, Canada, 
(Pages 1-30). 

Product Brochure for "Sony ICX085AL 2/3-inch Progressive Scan CCD Image Sensor" from 
Sony Corporation (Pages 1-20). 

Product Brochure for "ML1XX6 Series Laser Diodes for Optical Information Systems" by 
Mitsubishi Electric, (Pages 1-4, December 1999). 



STATEMENT OF PERTINENCE 

U.S. Patent No. 6,230,975 Bl to Colley et al. discloses an optical or symbol reader 
including CMOS circuitry preferably integrated on a single chip. A CMOS optical reader chip 
comprises a CMOS imaging array having a plurality of pixels each with a dedicated pixel-site 
circuit. Charge is accumulated at each pixel location transferred upon demand to a common bus. 
In a preferred embodiment, exposure time of the imaging array is controlled using a feedback 
loop. One or more exposure control pixels are positioned adjacent to or within the imaging array 
and receive light along with the imaging array. The charge of the exposure control pixel or pixels 
is measured against a threshold level, and the amount of time taken to reach the threshold level 
determines the time exposure of the pixels of the imaging array. CMOS signal processing 
circuitry is employed which, in combination with the exposure control circuitry, minimizes time- 
to-read over a large range of light levels, while performing spatially optimal filtering. Clocking 
cycles and control signals are time-adjusted in accordance with the varying output frequency of 
the imaging array so as to provide invariant frequency response by the signal processing circuitry. 
A multi-dimensional CMOS imaging array is also provided having simultaneous pixel exposure 
with non-destructive readout of the pixel contents. 

U.S. Patent No. 6,223,988 Bl to Batterman et al. discloses a hand-held bar code reader 
which includes a laser scanning module and a two dimensional image sensor and processor for 
reading a bar code. The laser scanner assists the 2D image processing by providing information 
on location, type, range, reflectivity, and presence of bar code for 2D reading. Additionally, the 
2D image reading operation is improved by using the laser scan as a spotter beam for aiming. 

U.S. Patent No. 6,166,770 to Yasuda discloses an image pickup apparatus with a focus 
detecting device for detecting a state of focus from a picked-up image signal outputted from an 
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image sensor, and an electronic zoom device for electrically magnifying the picked-up image 
signal. The image pickup apparatus is arranged to control an operation characteristic of the focus 
detecting device on the basis of the operating state of the electronic zoom device. 

U.S. Patent No. RE. 36,528 to Roustaei discloses the design for a bar code scanner using 
the Light Emitting Diode (LED), Optical Scanner assembly and Charge-Coupled Devices (CCD) 
capable of reading the barcode symbols at the variable distance. An optical passive elements for 
increasing the depth of field and a method of fabricating the scanning head by mass-production 
techniques are also disclosed. 

U.S. Patent No. 5,988,506 to Schaham et al. discloses a system for reading two 
dimensional codes as well as regular bar codes. A laser scanner generates a narrow horizontal 
beam which scans a code by means of a scanning mirror in the vertical direction. This mirror 
receives the reflected beam and passes it on to the lens array to yield high quality imaging 
characteristics all across a large field of view angle. The lens array and an auto focusing system 
produce images of the scanning lines in the sensor plane - a CCD linear array. In the sensor's 
plane, sub aperture diaphragms generate partially overlapping fields of view from each of the 
elements of the lens array. The system electronics converts the CCD linear array electrical signals 
into digital data. A module synthesizes in real-time the partially overlapping line sections of the 
image signal into an integrated continuous line signal and stores them consecutively in the image 
memory. A system processor operates an autofocus, as well as code classification and decoding 
algorithms. 

U.S. Patent No. 5,986,745 to Herniary et al. discloses a co-planar system for determining 
the shape and dimensions of a surface of an object which includes a projector for projecting a 
spatially coded pattern of radiation, e.g., light, in a selected plane onto the object. The system also 
includes a receiving device capable of imaging the reflected pattern in the selected plane, and a 
discriminator for determining which portion of the reflected pattern corresponds to which portion 
of the projected pattern. By this means, a received signal representing less than the complete 
reflection from the projected pattern can be correlated with a discrete portion of the scanned 
object. The object is moved relative to the selected plane and the procedure repeated to obtain 
enough reliable data to generate a reasonably reliable surface profile. The resulting set of received 
signals and correlations are used to calculate the shape and dimensions of the object. 

U.S. Patent No. 5,786,582 to Roustaei et al. discloses an optical device for reading one- 
and two-dimensional symbologies at variable depths of field, the device including a light source 
for projecting an emitted light beam towards the two-dimensional image and an optical assembly, 
or zoom lens, with dual field of view capability for focusing light reflected from the framed 
symbology onto a CCD detector for detecting the focused light and generating a signal therefrom. 
The dual field of view capability enables scanning of both wide and narrow fields of view. An 
apodizing filter is provided within the optical assembly to increase depth of field. Aiming of the 

Page 5 of 12 




sensor to read the symbology is facilitated by a frame locator including a laser diode which emits a 
beam that is modified by optics, including diffractive optics, to divide the beam into beamlets 
having a spacing therebetween that expands to match the dimensions of the field of view of the 
sensor, forming points of light at the target to define the edges of the field of view. One or two 
sets of diffractive optics may be provided, with one set corresponding to each position, for each of 
the dual field of view positions of the zoom lens. 

U.S. Letters Patent No. 5,710,417 to Joseph et al. discloses hand-held linear images, in 
which a plurality of the areas of differing light reflectivity of a bar code symbol or the like which 
are simultaneously illuminated using, for example, a beam of light that has an elongated cross- 
section. The light beam is swept over the symbol to be read in a direction transverse to the 
elongated dimension of the illuminated region so that a two-dimensional area of the symbol is 
illuminated over time. The reflected light is sensed by a ID CCD array. A microprocessor within 
the scanner provides visual feedback to aid a user in aligning the device, and also provides for a 
selectable aspect ratio for the image, a selectable image resolution and size, a selectable aspect 
ratio of the illumination, and a selectable pixel size. All of these options may be programmed 
within the microprocessor, enabling the device to read a large variety of two-dimensional symbols. 

U.S. Patent No. 5,672,858 to Li et al. discloses a scanning device for reading indicia of 
differing light reflectivity, including bar code or matrix array symbols, which has a single, light 
emitter, such as a laser or light emitting diode, for generating a scanning light beam to visually 
illuminate sequential portions of the indicia. A sensor, such as a charge coupled device (CCD) or 
other solid state imaging device, simultaneously detects light reflected from portions of the indicia 
and generates an electrical signal representative of the spatial intensity variations of the portions of 
the indicia. The scanning device may also include an ambient light sensor, and a second light 
emitter for use only in aiming or orienting the scanning device. A photodetector may also be 
provided to separately detect one symbol virtually simultaneous with the detection of another 
symbol by the sensor or to provide dual modalities. A method for reading indicia is also provided. 

U.S. Patent No. 5,621,203 to Swartz et al. discloses a plurality of the areas of different 
light reflectivity of a bar code symbol, or the like, which are simultaneously illuminated using, 
e.g., a beam of laser light that has an elongated cross-section. The laser light beam is swept over 
the symbol in a direction transverse to the elongated dimension of the illuminated region so that a 
two-dimensional area of the symbol is illuminated over time, until the symbol is read. The light 
that reflects from the illuminated region of the symbol is imaged on a linear sensor array, which is 
then scanned or read out to produce signals representative of spatial intensity variations of the 
imaged light along a linear path in the field of view. 

U.S. Patent No. 5,615,003 to Herniary et al. discloses a system for determining the shape 
and dimensions of a surface of an object which includes a projector for projecting onto the object a 
spatially coded pattern radiation, e.g., light. The system also includes a receiving device capable 
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of imaging the reflected pattern, and a discriminator for determining which portions of the 
reflected pattern corresponds to which portion of the projected pattern. By this means, a received 
signal representing less than the complete reflection from the projected pattern can be correlated 
with a discrete portion of the scanned object. The procedure is repeated to obtain enough reliable 
data to generate a reasonably reliable surface profile. The resulting set of received signals and 
correlations are used to calculate the shape and dimensions of the object. 

U.S. Patent No. 5,532,467 to Roustaei discloses an optical scanning head which includes at 
least one trio of light emitting diodes arranged so the LEDs emit light at different angles to create 
a fan of light. An optical module includes a light shield or "dark room" and a lens/filter assembly 
which provides control of the depth of focus of the scanner. The optical module is located behind 
the light source, and the detector, made up of a CCD array is mounted behind the optic module for 
detecting the light intensity in the reflected beam over a field of view across a bar code symbol. 
The CCD array generates an electrical signal indicative of the detected light intensity. A DC 
source or battery provides DC voltage to the LEDs and CCDs in response to a clocked signal 
which provides a gradual or sequential illumination of the LEDs and coordinates the activation of 
the CCDs in order to minimize power consumption during scans. 

U.S. Patent No. 5,378,883 to Batterman et al. discloses a hand-held bar code reader with a 
two dimensional image sensor for omnidirectional bar code reading, which includes variable 
imaging optics, and flash illumination with variable flash illumination optics. A spotter beam is 
provided for aiming the hand held bar code reader at a bar code symbol. The spotter beam is also 
used to measure the range to said bar code from said hand held bar code reader and to determine 
the focal length of said variable imaging optics and variable flash illumination optics. The 
imaging optics are adjusted automatically to provide the correct magnification and focus of a bar 
code regardless of range to the label. The variable focal length flash illumination optics are used 
to concentrate illumination energy only in the field of view of the bar code reader. The flash 
illumination energy is conserved by measuring the ambient light and setting the level of flash 
illumination energy in accordance with the measured level of ambient light. In such a manner, 
conventional, damaged, multiple, and stacked bar code symbols along with true two dimensional 
codes may be rapidly read over distances from under one foot to over several feet without having 
to align the bar code reader to the bar code. 

U.S. Patent No. 5,319,185 to Obata discloses a bar code reader which has a sensor unit to 
be mounted on an operator's finger and a decoder unit to be mounted on an operator's wrist, the 
sensor and decoder units being electrically connected by a cable. The sensor unit has a light- 
emitting device for emitting light toward a bar code to be read, a graded-index rod lens array for 
focusing an entire linear optical image of the bar code at one time in substantially the same size as 
the bar code, and a line image sensor such as a CCD for photoelectrically converting the entire 
linear optical image focused by the optical means into an electric signal. The decoder unit 
decodes the electric signal from the line image sensor. The light-emitting device, the rod lens 
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array, and the line image sensor are housed in a hollow casing. A movable tubular member is 
movably disposed in the hollow casing and has an end wall for abutment against the bar code. A 
switch for energizing the light-emitting device and the decoder unit is fixedly mounted in the 
hollow casing and triggerable by the movable tubular member when the movable tubular member 
is moved by abutment of the end wall thereof against the bar code. 

U.S. Patent No. 5,319,181 to Shellhammer et al. discloses a method and apparatus for 
decoding a two-dimensional bar code symbol using a charge-coupled device (CCD) camera or a 
charge-modulation device (CMD) camera. The CCD/CMD camera takes pictures of the symbol 
and the picture is converted into digital data. The location and orientation of the two-dimensional 
bar code symbol is determined and verified. Defects and damages on the symbol are detected and 
corrected. The symbol is scanned to read the codewords of the two-dimensional bar code symbol. 

U.S. Patent No. 5,296,690 to Chandler et al. discloses a bar code reader which includes an 
image capture means for storing a two dimensional image in memory, which stored image may 
include a bar code symbol within the field of view of the image. The bar code reader further 
includes method and apparatus for determining the location and orientation of the bar code symbol 
within the field of view of said image, and then filtering the located and oriented bar code symbol 
along an axis perpendicular to the detected orientation. Thereafter, the filtered bar code symbol is 
scanned and applied to a decoder to produce a decoded bar code output. 

U.S. Patent No. 5,212,390 to LeBeau et al. discloses a device which employs a laser diode 
and cylindrical lens to project a plane of laser at an incidence angle onto a plurality of leads. The 
light is simultaneously reflected from each of the plurality of leads. The light that is 
simultaneously reflected from each lead is detected by an image sensor. A digital computer 
computes the cotangent function of the incidence angle to detect an amount of displacement of at 
least one of the plurality of leads. 

U.S. Patent No. 5,192,856 to Schaham discloses in Fig. 1 a hand-held imaging device for 
reading and interpreting bar codes which illuminates the bar code with a fixed elliptical light beam 
(produced by an LED and collimating and cylindrical lens), and images the reflected beam onto a 
linear CCD array which is aligned with the light beam. The black and white bar information is 
detected by the electronically scanned elements of a linear CCD array. The limited operational 
range, determined by the optical system depth of focus, is enhanced significantly to a useful 
operational range by automatically focusing the image of the bar code on the CCD array. 

U.S. Patent No. 5,136,145 to Karney discloses a symbol reader that uses a dynamic 
random access memory as a detector element and a gradient refractive index material as the lens to 
capture a symbol image. The rod shaped lens passes through an opaque cover and confronts the 
array of memory elements in the memory. The cover is glued to a memory device package. The 
PN junctions of the random access memory are activated by light reflected from a symbol and 

Page 8 of 12 



appear as data when the random access memory is read out. The light can be provided by light 
emitting diodes positioned adjacent to the memory package and in a handheld wand that includes a 
light reflecting shield in which the symbol is positioned for reading. The wand is positioned over 
the symbol and a read button is depressed. A computer monitoring the read button activates the 
light emitting diodes and then reads out the contents of the random access memory, unscrambles 
the data, signals the user that the symbol has been captured and then outputs the symbol image. 

U.S. Patent No. 4,979,815 to Tsikos discloses a range imaging system, and a method for 
calibrating such a system which are based on the principles of projective geometry. The system 
comprises four subsystems: (1) a laser and a cylindrical lens or vibrating mirror for producing a 
planar beam of light; (2) an electronic camera equipped with a lens and an appropriate interference 
filter; (3) an electronic circuit for height (depth) measurements and video image generation; and 
(4) a scanning mechanism for moving the object with respect to the light beam and the camera so 
as to scan an area of the object surface. The system is calibrated by determining the position in the 
electronic image of the object surface at three different heights. The range image is generated 
from these three known heights from either a previously determined look-up table, or from a 
calculation based on the invariance of the cross-ratio, a well known ratio from projective 
geometry. 

U.S. Patent No. 4,900,907 to Matusima et al. discloses a handheld reader for reading 
optical information such as a bar code contains a reading sensor. An image of the optical 
information is imaged by light produced by a pair of LEDs and reflected from the optical 
information, via a reflecting mirror, a lens and a diaphram member, onto the reading sensor so that 
the image is converted into an electric signal. The pair of LEDs are disposed on both sides of the 
image sensor so that the images thereof are imaged near the optical information by light from the 
LEDs through the diaphram member, the lens and the reflecting mirror. The LEDs and reading 
sensor are controlled so that the LEDs are disabled from emitting light while the reading sensor 
performs the reading operation of the optical information. 

U.S. Patent No. 4,826,299 to Powell discloses a lens which has the appearance of a prism 
with a relatively sharp radius at the apex. This lens finds an application in expanding a laser beam 
in one direction only. 

U.S. Patent No. 4,687,325 to Corby, Jr. discloses a three-dimensional range camera system 
which measures distance from a reference plane to many remote points on the surface of an object. 
The set of points at which range is measured lie along a straight line (N points) or are distributed 
over a rectangular plane (MxN points). The system is comprised of a pattern generator to produce 
a lxN array of time/space coded light rays, optionally a means such as a rotating mirror to sweep 
the coded light rays orthogonally by steps, a linear array camera to image subsets of the light rays 
incident on the object surface, and a high speed range processor to determine depth by analyzing 
one-dimensional scan signals. The range camera output is a one-dimensional profile or a two- 
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dimensional area range map, typically for inspection and robotic vision applications. 

WIPO Publication No. WO 01/71419 A2 by Accu-sort Systems, Inc., discloses a scanning 
system which utilizes a randomly addressable image sensor which is selectively positioned at the 
Scheimpflug angle in the image plane in order to detect focused light reflected from an object. 
Light reflected from the object is focused onto the sensor through an objective lens. Since the 
sensor is mounted at the Scheimpflug angle, each strip within the depth of field of the object plane 
has corresponding pixels on the sensors which are in focus. 

WIPO Publication No. WO 01/2028 Al by Accu-sort Systems, Inc., discloses a system for 
scanning objects having a linear array sensor, adapted to detect light input signals. A lens is 
optically connected to the linear array sensor, and is adapted to receive and transmit an optical 
image located in a field of view along a lens axis to the linear array sensor. A light source which 
generates an illumination stripe in general linear alignment with the lens axis is provided. A 
cylindrical lens is positioned between the light source and an object to be scanned. The cylindrical 
lens adapted to collect, transmit and focus light from the light source to form the illumination 
stripe. 

U.S. Provisional Application No. 60/190,273 by Chaleff et al. publishes as WIPO 
International Publication No. WO 01/72028 Al, discloses an optical scanning system containing a 
coplanar camera utilizing a LED array light source and a linear CCD sensor array. 

WIPO Publication No. WO 99/64980 by Symbol Technologies, Inc. discloses an imaging 
engine and signal processing devices and methods for reading various kinds of optical codes. The 
compact structure (54") may include a two-dimensional image sensor, apparatus for focusing 
images at different focal disclosures, a laser-beam type aiming system, a hi-low beam illumination 
system employing an array of LEDs on lenslet plate (50), and related signal processing circuits. 

The Intevac Product Brochure for the Model 120 LIVAR® Short Wave IR Gated Camera 
describes a range-gated, laser-illuminated, two-dimensional imaging system that operates in the 
"eye-safe" wavelength band. 

The weblink for the Intevac New LIVAR® Imagery system 
(http:www.intevac.com/livaMmagery/livar_imagery.html) exhibits the Laser Illuminated Viewing 
and Ranging (LIVAR®) system which is designed for range-gated imaging in the 1.5 jam band. 

The StockerYale Product Brochure for the Lasiris™ SNF Laser describes Lasiris™ SNF 
beam shaping optics which transforms the familiar laser dot into different shapes and sizes. For 
example, a straight line can be projected by allowing one dimension of light to fan out while 
maintaining tight control over the other, resulting in a sheet-of light. This laser system 
incorporates an optical line generator that eliminates gaussian distribution of the light. 
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The Accu-Sort® Product Brochure for the AV3700 High Speed CCD Bar Code Reader 
describes a CCD camera that can be mounted over the belt or for side- and bottom-read 
applications. A new low-power, high-intensity LED-based illumination option, which can be used 
with the AV3700 reader, offers the same image quality and read rate performance as the standard 
sodium vapor lamps, and eliminates glare for side and bottom reading. 

The DALSA, Inc. Product Brochure for the DALSA IT-P4 Image Sensors feature 4096, 
6144, or 8192 elements and use proprietary technology to provide four outputs at 40MHz each. 
The DALSA IT-P4 Image Sensor employs buried channel CCD shift registers to maximize output 
speed and reduce noise. The IT-P4 sensor has a dynamic range of >1600:1 and a linear 
dependence on light level up to saturation. The exposure control of the IT-P4 sensor allows 
integration times shorter than the readout time. 

The Eastman Kodak Company Product Brochure for the KAF-4202 Series Full-Frame 
CCD Image Sensor describes a high performance monochrome area CCD image sensor with 2032 
H x 2044V photo active pixels designed for a wide range of image sensing applications in the 
0.4nm to l.Onm wavelength band. Typical applications include military, scientific, and industrial 
imaging. A 74dB dynamic range is possible operating at room temperature. 

The Camera User's Manual for the DALSA Piranha CT-P4, CL-P4 High-Speed Line-Scan 
Camera describes a modular camera which uses the reliability, flexibility, and cost-effectiveness 
of high- volume interchangeable parts. Within the Piranha camera, a timing board (PB-P1-X206) 
generates all internal timing and a driver board (PB-P1-X139) provides bias voltages and clocks to 
the CCD image sensor. For enhanced dynamic range, one or two A/D board (PB-xx-D344) 
process the video and digitize it to 10 bits before outputting the most significant 8 bits. 

The Sony Product Brochure for the ICX085 AL Progressive Scan CCD Image Sensor Chip 
describes a 2/3-inch interline CCD solid-state image sensor with a square pixel array. Progressive 
scan allows all pixel signals to be output independently within approximately 1/12 second. This 
sensor chip features an electronic shutter with variable charge-storage time which makes it 
possible to realize full-frame still image without a mechanical shutter. High sensitivity and low 
dark current are achieved through the adoption of HAD (Hole- Accumulation Diode) sensors. 

The Mitsubishi Product Brochure for the ML1XX6 series laser diodes describes a high 
power AlGalnP semiconductor laser which provides a stable, single transverse mode oscillation 
with emission wavelength of 658-nm and standard CW light output of 30mW. 
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A separate listing of the above references on PTO Form 1449 and a compact disc 
containing copies of these references (in .pdf format) are enclosed herewith for the convenience of 
the Examiner. 



Respectfully submitted, 



Dated: July 31, 2002 




■ 



Thomas J. PerkoWski 
Reg. No. 33,134 
Attorney for Applicants 
Thomas J. Perkowski, Esq., P.C. 
Soundview Plaza 
1266 East Main Street 
Stamford, Connecticut 06902 
203-357-1950 
http://www.tjpatlaw.com 
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Commissioner of Patents and 
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Washington, D.C. 20231 




Thomas J. PerkoWski, Esq. 
Reg. No. 33,134 
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